Combined l2 data and gradient fitting in conjunction with l1 regularization

نویسندگان

  • Stephan Didas
  • Simon Setzer
  • Gabriele Steidl
چکیده

We are interested in minimizing functionals with l2 data and gradient fitting term and l1 regularization term with higher order derivatives in a discrete setting. We examine the structure of the solution in 1d by reformulating the original problem into a contact problem which can be solved by dual optimization techniques. The solution turns out to be a ’smooth’ discrete polynomial spline whose knots coincide with the contact points while its counterpart in the contact problem is a discrete version of a spline with higher defect and contact points as knots. In 2d we modify Chambolle’s algorithm to solve the minimization problem with the l1 norm of interacting second order partial derivatives as regularization term. We show that the algorithm can be implemented efficiently by applying the fast cosine transform. We demonstrate by numerical denoising examples that the l2 gradient fitting term can be used to avoid both edge blurring and staircasing effects. Short title: l1 regularized data and gradient fitting AMS Subject Classification: 65K10, 65F22, 65T50, 49M29

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Efficient Online and Batch Learning Using Forward Backward Splitting

We describe, analyze, and experiment with a framework for empirical loss minimization with regularization. Our algorithmic framework alternates between two phases. On each iteration we first perform an unconstrained gradient descent step. We then cast and solve an instantaneous optimization problem that trades off minimization of a regularization term while keeping close proximity to the result...

متن کامل

Efficient Learning using Forward-Backward Splitting

We describe, analyze, and experiment with a new framework for empirical loss minimization with regularization. Our algorithmic framework alternates between two phases. On each iteration we first perform an unconstrained gradient descent step. We then cast and solve an instantaneous optimization problem that trades off minimization of a regularization term while keeping close proximity to the re...

متن کامل

Efficient Minimization Methods of Mixed l2-l1 and l1-l1 Norms for Image Restoration

Image restoration problems are often solved by finding the minimizer of a suitable objective function. Usually this function consists of a data-fitting term and a regularization term. For the least squares solution, both the data-fitting and the regularization terms are in the 2 norm. In this paper, we consider the least absolute deviation (LAD) solution and the least mixed norm (LMN) solution....

متن کامل

L1 Splines for Robust, Simple, and Fast Smoothing of Grid Data

Abstract: Splines are a popular and attractive way of smoothing noisy data. Computing splines involves minimizing a functional which is a linear combination of a fitting term and a regularization term. The former is classically computed using a (weighted) L2 norm while the latter ensures smoothness. Thus, when dealing with grid data, the optimization can be solved very efficiently using the DCT...

متن کامل

Hyperbolic estimation of sparse models from erratic data

We have developed a hyperbolic penalty function for image estimation. The center of a hyperbola is parabolic like that of an l2 norm fitting. Its asymptotes are similar to l1 norm fitting. A transition threshold must be chosen for regression equations of data fitting and another threshold for model regularization. We combined two methods: Newton’s and a variant of conjugate gradient method to s...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Adv. Comput. Math.

دوره 30  شماره 

صفحات  -

تاریخ انتشار 2009